Renormalization Group Approach to Spin Glass 

Systems 

G. Parisi a R. Petronzio b F. Rosati c 

November 17, 2000 



a) Dipartimento di Fisica and INFN, Universita di Roma "La Sapienza", 

P.le Aldo Moro 2, 1-00185 Roma, Italia 
e-mail : gior gio . parisi@r omal . infn . it 

b) Dipartimento di Fisica and INFN, Universita di Roma "Tor Vergata", 

via della Ricerca Scientifica 1, 1-00133 Roma, Italia 
e-mail: roberto.petronzio@roma2.infn.it 
c ) Dipartimento di Fisica, Universita di Roma "Tor Vergata" , 
via della Ricerca Scientifica 1, 1-00133 Roma, Italia 
e-mail: francesco.rosati@roma2.infn.it 



Abstract 

A renormalization group transformation suitable for spin glass models and, more gener- 
ally, for disordered models, is presented. The procedure is non-standard in both the nature 
of the additional interactions and the coarse graining transformation, that is performed on 
the overlap probability measure (which is clearly non-Gibbsian) . Universality classes are 
thus naturally defined on a large set of models, going from Z 2 and Gaussian spin glasses to 
Ising and fully frustrated models, and others. 

The proposed analysis is tested numerically on the !Li Edwards-Anderson model in d = 4. 
Good estimates of the critical index v and of T c are obtained, and an RG flow diagram is 
sketched for the first time. 

PACS Numbers: 75. f O.Nr Spin-glass and other random models; 05. f O.Cc Renormalization 
group methods. 

In the understanding of critical phenomena a crucial role is played by the renormalization 
group (RG) analysis [l|, 3- R provides a theoretical foundation of the universality principle and 
of the scaling theory, as well as a method for a direct evaluation of critical indices. Despite the 
fact that both universality and scaling are largely used in the study of spin glass (SG) models, 
the RG approach has not been fully developed (see however (5|, |6|). Classical tools of RG analy- 
sis are not suitable for spin glasses, mainly because a direct transformation of the Hamiltonian 
is impossible. The random nature of the couplings require also the additional interactions to 
be introduced as random variables. But averaging over disorder makes it impossible to con- 
sider simple Boltzmann-Gibbs distributions, and to use the spin variables for a coarse graining 
transformation. 
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Therefore we propose a RG transformation on the overlap distribution, in the spirit of the 
probabilistic interpretation of the renormalization group Universality classes are naturally 
defined on a large set of models, going from IL2 and Gaussian spin glasses to Ising and fully 
frustrated models, and others. 



1 The model 

A large part of the discussion will be general, but to be explicit let us consider the Edwards- 
Anderson spin glass model ||. Let a x be Ising spins located at the sites of a ci-dimensional cubic 
lattice (x € A C Z^). The Hamiltonian of the model is given by 



H(J, a) = - JxyVxVy, (1) 



where the sum is over the couples of nearest neighbouring sites. Some kind of boundary con- 
ditions (e.g. periodic) are also provided. The quenched disordered interactions J xy J s are inde- 
pendent random variables with zero mean and unit variance. Denoting by E expectation on J 
variables, we have 

E(J xy ) = 0, E(J 2 xy ) = l. (2) 

A Boltzmann-Gibbs measure on the spin variables is introduced, following the usual rules of 
statistical mechanics. It will be denoted by angular brackets (•). Expectation on the disorder 
is taken only after Boltzmann averages are calculated, and the thermodynamic limit for the 
appropriate quantities is eventually taken afterwards. The model is symmetric under the gauge 
transformation defined by 

{Jxy ~ * J X y = e x&yJxy m\ 
a x -> a' x = e x a x 

where e x = ±1 are the gauge group parameters. Let us introduce the overlap variables. Consider 
s replicas (copies) of the spin variables = 1, . . . , s. The Hamiltonian of the replicated 

system is given by TL = ^}Z a H(J } cr^), therefore replicas are independent from each other, but 
feel the same disorder configuration J. For any couple of replicas (o, b), introduce the site overlap 

q { x a ' b) 

^=4 a) ^e2 2 - (4) 

The overlap probability distribution \x can be implicitly defined through the overlap expectations, 
that involve both the thermal average and the average E over disorder. For any smooth function 
F define 

(f (4 12) , 4 23) >••■)> = E 1 (4 12) , 4 23) >•••)>)' (b) 

where expectation with respect to the /i distribution is denoted by ((•)). All physical observables 
can be expressed in terms of overlap observables, so that the full physical meaning of these 
models is contained in the overlap probability measure. 

Let us introduce the average over the volume of the site overlap, the total overlap, often 
simply referred to as "overlap" , 

9 (o,6) =iii£^ ,6) - (6) 
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Given 2 replicas, the distribution of the overlap q( 1,2 ) will be denoted by p( 2 \ An other inter- 
esting observable is the correlation function of site overlap, 



C(0 = ^E((4 1,2) &?))c- (7) 
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Two main difficulties arise in the application of RG analysis to spin glasses: the choice of 
the coarse graining transformation and a correct parameterization of the space of Boltzmann 
measures - that is, the nature of the additional interactions. Let us begin by the second. In spin 
glasses the single interactions are not set explicitly, but only through their distribution. Instead 
of coupling constants we have distributions of couplings, and different distributions give rise to 
different physical models. 

Therefore, our proposal is to keep the form of the Hamiltonian fixed, but to take into account 
a large space of disorder distributions, such that the J's are not independent variables. This 
choice is coherent with the random nature of the couplings, and introduces effective long range 
interactions between the spins through the correlations of the J's. More generally, new explicit 
spin interactions could be added, carried by new disorder variables. This procedure would lead 
to a very large space of models that can be very interesting to be studied, but in our opinion 
it is unnecessary for our present purpose. Notice that it would be redundant to introduce new 
spin interactions depending only on the old disorder variables. 

The disorder distribution must respect gauge invariance, therefore it will be parameterized 
as follows 

p(J) = exp (j^Ki Wi) , (8) 

where the Ki G R are parameters and the Wi are the Wilson's loops, i.e. products of J's along 
a closed path. Therefore we can consider the following general disorder probability distribution 

PK = C K e W lK 1 £ J 2 xy + K 2 4 y + K 3 ^2°a + o(J 4 )\ , (9) 

V (x,y) (x,y) oi J 

where Ck £ R is a normalization constant, and the symbol □ denotes the plaquette terms of 
the kind J x ,yJy,zJz,wJw,x- Expectation with respect to this distribution will be denoted by Ek- 
The Gaussian Edwards- Anderson model corresponds to K\ = —1/2, Ki = ^ 1, while the 
Z2, E-A model is obtained in the limit 

K Xi K 2 -» oo, s.t. Kt/K 2 = -2, (10) 
Ki = Vo2. 

Another interesting distribution is obtained from the Z2 E-A model, adding a plaquette term: 

K U K 2 -> 00, s.t. K x /K 2 = -2, 

K 3 ± 0, (11) 
Ki = Vj>3. 

Considering the disorder variables only, this is the well known pure gauge 7L 2 model @. In the 
limit K 3 — > 00, frustration disappears and the Ising model is obtained, up to a simple gauge 
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transformation. Attention is to be payed to ensure that all Polyakov loops are positive, to avoid 
the appearance of interfaces. A change of behaviour is to be expected at the deconfinement 
transition. In dimension d = 4, the transition is of the first order: at \K%\ > K% = log{y/2 + 
l)/2 ~ 0.4407 the average plaquette jumps to |£^(n)| ~ 1. The opposite limit, K% — > — oo, 
leads to the fully frustrated model. 

According to eq. (|5|), we introduce the overlap probability distribution fix corresponding to 
the disorder measure Ek- Let us denote by M. the space of such distributions. Notice that the 
dependence on (3 = T _1 of [Ik could be included in the K's parameters, performing the simple 
substitution J — > TJ, so that the Boltzmann factor does not contain /3, and Ep(J 2 ) = i . 

The choice of the coarse graining transformation is related to the nature of the order pa- 
rameter. Block transformations of the spins are suitable for the Ising model because the order 
parameter is the average magnetisation, and the diverging correlation length is given by the spin 
correlation function. For spin glasses the elementary physical observable is the site overlap , 
while the phase transition is characterized by a functional order parameter, the distribution 
of the overlap between two replicas. This distribution is non-trivial in the broken replica sym- 
metry phase ||, [nj. The correlation length defined by the correlation function C(r) diverges at 
the critical point. For those reasons, we will perform a block transformation on the site overlap, 
leading to a renormalized overlap defined by 

q B = sign (j2 x€B qx ) ■ ( 12 ) 

The RG transformation Ri for a rescaling factor / is defined on the overlap distribution [i as 
follows: 

^\ q ') = J2RdQ',q)Kq), (13) 

where x' = x/l is the rescaled lattice coordinate and E>i{lx') is the block of side / located in 
x = lx' . Let us assume the following 

Ansatz The set M of all the overlap distributions that can be represented through the 
parameters K is invariant under the RG transformations, i.e. 

Ri (/%(u) = %w G M. (15) 

Exploiting the Ansatz, we can introduce the RG transformation on the parameters space 

= RiK^\ (16) 

and look for the fixed points K* = RiK* and the corresponding universality classes. The 
proposition that Gaussian and 1L<i SG models belong to the same universality class is therefore 
formulated in a precise theoretical framework. We expect to find the fixed point of the spin 
glass transition in the deconfined phase, while for \K%\ > the phase transition is to be 
characterized by different fixed points, somehow related to the Ising model (or, more likely, to 
the diluted Ising model) for K% positive, and to the fully frustrated model for K% < —K^ and of 
the Ising model ferromagnetic transition. The relations with the fully frustrated model may be 
understood, and the intermediate cases would also be clarified, in terms of universality classes. 
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We have so far introduced a parameterization of the space of overlap probability measures 
and a renormalization group transformation in this space, suitable for spin glass models. The 
parameterization is rather implicit, and not easy to be employed in analytic calculations. There- 
fore, this RG transformation has been tested numerically, with the Monte Carlo method. 



3 Finite-size renormalization group 

The RG transformation defined in the previous section has been applied to the 4-dimensional 
E-A spin glass model with periodic b.c, using Monte Carlo method. A typical problem of this 
approach is that one is limited by the finite size of the lattice to a few RG iterations. Moreover, 
it is practically very difficult to consider a large number of parameters, giving rise to truncation 
errors. To minimize the effect of these approximations, the following method has been applied, 
as introduced in ||. For a lattice of linear size L, block variables of size L/2 are defined, 
obtaining a 2 d system after one RG iteration. Therefore the number of possible K parameters 
in the renormalized system is very limited and the truncation error is controllable. By varying 
the initial lattice size L we obtain many sets of parameters K'{K; L), renormalized by different 
rescaling factors / = L/2, but realized in the same effective lattice 2 d . Therefore are avoided the 
systematic errors due to the comparison of if's acting in different effective lattices and, thus, 
with different truncations. At the critical point, the couplings are independent of the rescaling 
factor, and the K'(K C , L), for different L's, will coincide. This gives an estimate of K c , i.e. of 
T c . For any pair of sizes a different estimate K C (L±, L2) is obtained, with a small dependence 
on L\, L2 vanishing for large sizes. An estimate of the thermal critical index v can be obtained 
independently from each coupling, according to the well known formula 

" = yT ^ = ' (17) 

Clearly, the numerical values of the resulting fixed point K* are not the true infinite volume 
values. However, the estimates of K c and of the critical index are weakly affected by finite-size 
effects. 

The general idea of interpreting the ratio of different lattice sizes as RG scaling factor was 
developed by Nightingale and is known as phenomenological RG P]. In this approach the test 
quantities are the specific heat or the susceptibility of the original system and not renormalized 
quantities like in the method exploited in this paper. Moreover, it does not contain any effective 
Hamiltonian (or effective measure). 

In the Monte Carlo runs we have considered the Z2 E-A model in 4 dimensions, with periodic 
boundary conditions. Only one additional parameter, K$, has been introduced in the effective 
measure. The RG transformation used was a majority rule on the block overlap, with a tie- 
breaker if zero. The renormalized parameters where obtained with a matching condition on the 
overlap probability distribution. The complete procedure is as follows. 

1. MC run on L = 2 system, for a wide range of temperatures and values of the K% parameter. 
The configurations of the disorder J where obtained by independent pure-gauge MC runs. 

2. MC run on large systems, L = 6,8, 10, 12, measuring the renormalized overlap distribution, 
for fixed K3 = and various temperatures. 
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Table 1: Parameters of the spin glass simulations. Columns correspond to the linear size L, the 
number of MC-PT steps for thermalization and measures, the number of J samples, the number 
of temperatures for the PT algorithm Nt, temperature step 5T and range T m j„, T n 



L max ■ 



3. The renormalized overlap distribution is matched to the overlap distribution measured in 
the L = 2 system, finding the effective parameters T', K' 3 . 

4 Numerical results 

The algorithm used in the MC runs is a parallel tempering (PT) Metropolis, exploiting multi- 
spin coding. The fast computer code has been provided by E. Marinari and F. Zuliani. Table || 
lists the parameters used in the MC runs. For the purpose of studying the critical point it 
is unnecessary to measure observables at very low temperature, and this considerably simpli- 
fies the thermalization. Indeed, in the cold phase the renormalized parameters flow rapidly to 
the zero-temperature fixed point. The lowest temperature attained was about 0.93 T c . Ther- 

(2) 

malization was verified by the symmetry of the Pj (q) for any given sample of J's, while the 
efficiency of parallel tempering was controlled through the histogram of the temperatures vis- 
ited during each run. In the MC runs on the 2 d system large statistics is needed because of 
the large finite-size fluctuations of both the spin glass and the pure gauge runs. Ten values 
of K3 were considered, ranging from —0.06 to —0.28. The temperature spacing 5T is nar- 
row in order to dispose of a dense spanning of temperatures in the subsequent analysis. 
The overlap distributions of the small system, and the renormalized overlap distributions of 
the large system have been fitted with polynomials of K% and T, respectively, and matched 
together for many values of T' . This procedure avoids the necessity of bi-dimensional fits. The 
matching was performed by numerical minimization of the x 2 - An example of matching of the 
overlap distributions is shown in figure |||. Statistical errors on all the intermediate and final 
quantities were estimated with jack-knife procedure on the data of the single J samples. The 
renormalized parameters T' and K' 3 are plotted in figures |l| and 

The curves T'(T; L) of figure [l] cross in a same point, within the error bars, apart from the 
curve for L = 6 which is affected by strong finite size effects. To obtain numerical estimates 
of the crossing point and of the slopes, the curves have been fitted, using the initial JK bins. 
The results are listed in table The curves K%(T\ L) of figure [2] are approximately constant 
close to the critical temperature, and match for all temperatures for L = 10, 12. This means 
that in the plane (T, K%) the repulsive direction at the fixed point is orthogonal to the K% axis, 
as sketched in figure [3|. Estimates of the critical temperature Tc and of the exponent v agree 



with previous numerical results by E. Marinari and F. Zuliani [1C], obtained with the finite-size 
scaling of Binder cumulant, i.e. T c = 2.03(3) and v = 1.0(1). 
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Figure 1: The renormalized temperature T' as a function of the temperature T. 
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Table 2: Estimates of the critical temperature Tc and exponent v obtained from the curves of 
figure [2|. 
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Figure 2: The renormalized coupling K% as a function of the temperature T. Negative values 
correspond to negative average plaquette, i.e. , increased frustration. 
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Figure 3: Qualitative picture of the RG flow showing the finite temperature fixed point. The 
repulsive direction is approximately horizontal; the critical temperature decreases for higher 
values of -K3 because of the higher frustration. 
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Figure 4: The overlap distribution of the L = 2 system at T = 1.3, K 3 = -0.244(9) (I), and the 
renormalized overlap distribution of the L = 12 system at T = 2.084(4) (II), corresponding to 
the matching point. 
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5 Conclusions 



A renormalization group transformation suitable for spin glasses, and more generally for disor- 
dered systems, has been introduced for the first time. The procedure is non-standard for two 
reasons. 1. The coarse graining transformation is performed on the distribution of site overlaps, 
which clearly is not a Gibbs-Boltzmann distribution. 2. The space of such distributions is pa- 
rameterized by additional terms in the distribution of the disorder, while the Hamiltonian of the 
system is kept fixed. This leads to a quantitative definition of universality classes for spin glass 
models, clarifying also the connections between Z2 and Gaussian spin glasses, the Ising model, 
the fully frustrated model. 

This RG scheme has been tested numerically with Monte Carlo method in the case of the 
4-dimensional EA spin glass. Good estimates of the critical temperature and of the exponent v 
have been obtained with moderate computer time. 

A plot of the RG flow in spin glass models has been sketched for the first time. 
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